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ABSTRACT 

The Southeastern New Mexico Bilingual Program for 
1971-72 was evaluated in this report. The academic growth in both 
English and Spanish and the self-image of 20 bilingual children 
randomly chosen from the 1st, 2nd, and 3rd grades were compared to 20 
students in the 1st, 2nd, and 3rd grades in the standard program. 
Groups were matched by chronological and mental age, IQ, family 
income, family situation, number of children in family, parents* 
education and occupation, and home language. The evaluation 
instruments were the Pea body Picture Vocabulary Test in both English 
and Sp€Lnish; the Stanford Achievement Test; the Goodenough Draw-A-Man 
Test; the Self -Image Test; the Otis-Lennon Mental Ability; and the 
California Test of Basic Skills. Findings showed thav the bilingual 
group fell lower in achievement than the control group; the bilingual 
program began to show improvement more in the higher grades; and the 
bilingual group did not lose any oi its self-image during any one 
year although it did drop from the close of one grade to the close of 
another, whereas the control group lost during each year* (NQ) 
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The Evaluation Design 



This final report attenpts to follow closely the evaluation set-up 
as designed for the past school year. The design set certain goals to 
be attained in academic growth in both English and Spanish as compared 
to a control group in the standard program. 

Another aspect of the design called for evaluation of the same groups 
in regard to the self-image. The goals set were to show that the children 
in the bilingual program would have a better self-image, be more responsive 
and less inhibited in realms of traditional restraints. * 

Informal study was given the reactions of teachers, aides, parents and 
community to the program with special attention paid to the increase of in- 
fi'om former years. 

The selection of valid instruments for this program and the population 
of this community has been quite a problem. 

The Evaluation Instruments 

1. The Peabody Picture Vocabulary Test is unsatisfactory for the pre 
and post testing needed throughout the several years. Some children remember 
from previous bouts with the instruments. It would be helpful if the Peabody 
Conpany would rearrange the order of picture designation for post testing. A 
Spanish version has been evolved by bilingual personnel who are thoroughly 
acquainted with the local variety of Spanish. However, the test should involve 
a different set of pictures from time to following time. 

2. The Stanform Achievement Test which has been used from necessity is 
inadequate for children not too well acquainted with the English language and 
especially not with the Stanford terminology. 

3. The Goodenough Draw-A-Man Test was used for aid in choosing the match- 
ing Bilingual and Control groups of children. This is not always a sure thing 

as older siblings have sometimes supervised artistic efforts in pre- school years. 
However, there is no section in the Evaluation Design for treatment of the 
Goodenough Test. 

4. The Self-image Test devised for use in this area suffered when some 
children started marking the item in the same position each time - possibly 
because of lack of understanding. The spring copy was rearranged to p'^event 
this and it proved more reliable. The wording should be changed to conform 
to first grade recepts. The understanding of words such as "many", "few", 
"sometimes", and "somethings" are not too well understood by the average beginner. 



5. The Otis-Lennon Mental Ability was given city-wide to first 
grades in tlie fall so t!ie Bilingual Department followed with another 

in the spring. It was also given to thr second and tliird grades by the 
Department, fumisliing material for an interesting comparison with tlie 
scores from tlie Peabody. 

Tlie California Test of Basic Skills was administered as a city- 
wide test in the spring and repeated in tlie fall. If the Bilingual Depart- 
menl^ wishes to continue the SAT program it ^ould be well not to include the 
results of the California in its evaluative processes. 

6. Tlie testing program suffers some what because of the variety of 
administrators, conditions and length of the processes. Since all children 
involved are scattered throughout various rooms in various schools, there 
is always a greater degree of adjustment for some than others. It might be 
well to collect all participants by bus to a room unfamiliar to any and the 
test administered to the entire groups by the same person. 

Matdiing Control Group 

Tlie original plan for selection of a matching control group for the 
Bilingual cliildren has been carried ou^ each year from the inception of 
the program. 

The Bilingual group of twenty youngsters chosen at random from the 
year's first grades are categorized and tv/enty counterparts are searched 
out for the Control group. Matcliing was done on the following basis: 



Each bilingual student was matclied with a standard program student 

as to: 

1. Chronological age (within two monclis) . 

2. Mental Age (within three months). 

3. I.Q. (measured on same instrument, within ten points). 

4. Family on Welfare or not. 

5. Family income comparable. 

6. Family situation alike as to parents or parents at home. 

7. Number of children 

(a) , three or less 

(b) . four to seven 

(c) . over seven 

8. Occupation of parents 

(a) , skilled 

(b) . unskilled 

9. Parents education 

(a) , under nine years 

(b) . over nine years 
10. Home language 

(a) . predominately Spanish 

(b) . predominately English 

(c) . Spanish and English 



Circumstances over which the Bilingual Department has no control can 
affect the groups considerably. Families move out of to\m or to a city scliool 
not involved with the program. Then replacements are necessary. Second, 
replacement screenings are often not so meticulously done and we sometimes 
find odd pairings. A second liardship is the high absentee factor, p condition 
nullifying complete analysis of any one group. 

In the current year practice involving tlie spring Fiesta kept a higli 
degree of excitement during the spring testing program (whicli unfortunately 
could not be furtlier delayed). No doubt the scores of the Bilingual group 
suffered quite a loss. 

Results of all recorded tests and fulfillment or lack of fulfillment 
are recorded in detail in the Bilingual office but only scores and percent- 
ages pertinent to the Evaluation Design are included in this report. Attempts 
have been made to follow tlie sequence of the design as closely as possible 
so that the reader may check for verification. 
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SUf.M\RY OF SrrVM-OI^U AailhAI^NENT RliSULTS 



Grade 1 - Results in first grade show the following: 



1. The Bilingual Group as a whole fell A7S% lower in Achievement than 
the Control Group. 

2. Tlie Non-Dominant Spanish Speaking Children of tlie Lab Group fell .58-o 
lower than Non-Dominant Spanish Speaking Giildren of tlie Control Group. 

3. The Dominant Spanish Speaking Cliildren of the Lab Group fell .1-6 lower 
than Dominant Spanish Speaking Qiildren of the Control Group. 

4. I.Q.'s of the Bilingual Group average 94.9, Non-Dominant Spanish Speaking 
□lildren of Lab Group average 94.0 I.Q., Itominant Spanish Speaking 
Cliildren of Lab Group 84.7. 

5. I.Q.'s of rooms not involved in the program range from 99 to 105. 

Obviously, there was a bias in allocation of first graders. Tne four sets of 
tests were done under rather harrowing circumstances as the children were excited 
in their praciticing for a Fiesta that same week. The Fiesta members were prin- 
cipally from the Bilingual Groups. The excitement on tlie part of the performers 
could easily account for a S% error in response. 

It will be well to note the small percentages quoted. Tlie amounts are so minute 
as to be unworthy of note. Indeed, the average of the entire summary is so 
superior to results of achievement in year? previous to the program that we may 
regard the above results as being very optimistic. 



Recommendat ions : 



1. Eliminate fall testing (except as dictated by school policy) for 
second and third grades. 

2. Find out from school the series of tests that will be given and 
utilize for the program by giving the same as post-test in the spring. 

3. Omit Otis Lennon Mental Ability Test for spring. 

4. Begin April 15 or thereabouts for testing. 

5. Begin a search for more adequate testing vehicles --such as criterion 
developed tests. 



INFORMAL FINAL EVALUATION RESULTS 

Page 8 of the Evaluation Design has the Process Objectives, Bilingual Component, 
thus: "All children will be taught by Bilingual teachers utilizing both English 
and Spanish for teaching purposes on a 50% classroom time basis." In a question- 
naire given the teachers and aides at the close of the school year this question 
evoked tlie recorded answers: 

Question: 'To what extent was your classroom conducted in a bilingual 

manner?" (two languages used for instruction) 
Answer: More English than Spanish .39% 
One subject taught in Spanish 
Two or three subjects in Spanish .44% 
All subjects taught bilingually .15% 

The answers do not specify how often these classes were taught in Spanish. If 
they were given equal time the 15!f group reached the goal set. The other groups 
would of necessity affect the over all picture. Perliaps a 30-% would be a correct 

ERLC 



10 



cxtimatc. \ limitation revealed the fact that all rooms allowed for a definite 
Spanish lesson in which vocabulan* and pronunciation were em]iliasized. It appeared 
that oral participation by the pupils was inadequate in many classrooms. 

In the Spanish Lab Component wherein it was designated that ".Ml children 
will be tauglit standard curriculum by tlie use of a teacher-teacher aide team where 
at least one member of the team is bilingual. Tlie bilingual aide will present all 
areas of the curriculum in Spanish under direct supervision of tlie lab-teacher on 
a 15 hour per week basis depending on teacher diagnosis of required instruction." 
Since the aides were in the classroom only in the mornings this vould have required 
their constant teaching in Spanish. Tins was not accomplislied. 1-ven thougli S2% 
of the instructors felt teaching subject matter in SpaJiish is very ini^ortant and 
38 0 felt it is of some importance, they are constantly aware of the demands of a 
rigidly linglish curriculum and push hard to meet those demands. Tliis situation 
is often seen in the sacrifice of the sciences for the requirements of reading. 
On site visitation showed there were efforts being raade in the way of visual aide 
to help attain more efficiency and understanding in tlie Spanish language. Tlie 
involved people realize the situation, are trying to adjust the daily routine to 
accomplish the desired goals and many express a desire to '^lave more time". Tlie 
most outstanding achievement in the work is the advance of the para-professionals 
from clerical work to instructional activities. 



T\\c Hvaluation Design tpagelO) states: "Students in the Program will be 
regularly instructed in the Spanish Language skills of listening, speaking, read- 
ing, and writing as outlined in the curriculum guide". Tliis was to be checked by 
the Project Director in his monthly observations of the teacliing and the inspec- 
tion of lesson plans and teaching materials. The director made more frequent 
observations than designated in the Design and he noted that better results were 
obtained and teaching was more effective as the lesson plans were better planned. 

A questionnaire prepared for all personnel reveal that although everyone 
felt the importance of teaching in Spanish, not so many were too sure of accomp- 
lisliment. That may be because several of the professionals knew so little of 
the language themselves. Some pertinent questions and answers in line with this 
goal are: 



Question: In your opinion, liow wll are your students prepared to operate 
in a bilingual setting? 

Answers: llave had little preparation. 5% 

Have had some preparation. 4S^ 

Have had adequate preparation. 251 

Will do well. 25% 



Question: itow much improvement has the Spanish surname child made in 
his Spanish? 



Answers: S% or less 
10% 
30% 
501 

70% or more 



2% of teachers 
17% 
26% 
28% 
27% 
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Question: llow much improvement has tlie liislisli surname cliild made in 
his Spanish? 



i\nswers: S% or less no instructors 

10% 13 plus % 

30% 27 plus % 

50% 22 plus % 

70% 36 plus % 



From a study of the above figures we draw the conclusion that the 
teachers are not too s\are of the results of their bilingual efforts. Tlie first 
question drew forth some revealing answers. Itowever, in the primary grades 
many pupils can not adequately express themselves in their native tongue and 
writing stories is a rather sketchy affair. If first and second grade children 
do write a few Spanisli sentences it is an accomplishment. 

The Design page 12 repeats this goal in regard to the program from the 
English "Language skills of listening, speaking, reading, and writing as outlined 
in the Curriculum Guidelines." The teachers in this program are ver>^ good ones 
and "hew the line" as regards the English Curriculum Guidelines. Tliese are 
their feelings regarding the influence of the two language effect: 



Question: In your opinion, \<l\at percentage of Danish Surname Children 
in your class learned at least 5^6 more of tlic standard cur- 
riculum as a result of bilingual instruction? 



Answers: 10% or less 15 plus % of teachers 

30% 20 plus % 

S0% 20 plus % 

70% 25 plus % 

90% or better 15 plus % 



Question: In your opinion, what percentage of Spanisli Surname Children 
in your class liave learned as much of the standard cur- 
riculum even though part of the instruction was bilingual? 



Answers: 10^ or less 

30% 
S0% 
70% 

90% or better 



5^6 of teachers (approximately) 

2% 
20% 
2S% 
451 



Question: In your opinion, what percentage of English Surname Qiildren 
in your class have learned as much of the standard curriculum 
even though part of the instruction was bilingual. 



Answers : 



10% or less 

30% 

50% 

70% 

901 or better 



S% of teachers (approximately) 

8% 

2% 
17% 
64% 



12 



Tne answers to tlic queries definitely show the feeling that the Program 
is helpful to both groups. Ihc response to the finglish Surname aiildren 
surpassed the Spanish Surnames which is surprising as well as pleasing. Tins 
overcomes any objection that sometimes aiises over the linglish Speaking Quid 
being slowed down- in his learning. 
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SUMMARY FOR PI^ABODY AND SELF-IMAGE 



A study of the c>p:in.ish version of the Peabody Test reveals comparative 
results in the three grades involved. All fell short or the aspired S^6 higher 
goal on the part of individual Bilingual Dominant Spanisli Speaking Children 
when compared to their Control coui.terparts. It is interesting to note tliat 
had the children's positions in the line-up been changed the percentage would 
have risen 30% in the first grade, 7% in the second and 77% in the third grade. 
Tliis last group would have lacked only one child reaching the desired goal. 
It is quite evident the program begins to show tlie improvements more in the 
higher grades- a very valuable point to remember. It is also necessary to keep 
in mind the fact that the Bilingual beginners as a group were so located as 
to fall about 5 points below other first grade rooms in their respective I.Q.'s. 
This fact should not be lost in the continuing process of comparison as the 
years pass by. It is unreasonable to require children to make progress of 5% 
more than children of higher I.Q. It is more than enough if they can just 
keep abreast. 

In the English version of the Peabody Test the results show the highest 
percentage is with the first grade with a gradual drop through the third. Tliis 
does not necessarily mean the saturation point is being reached, but it may point 
favorably to an expanding basis from which to figure progress percentage. 
Although the performance objective in the Evaluation Design was not met, scores 
were quite complimentary in the light of the limiting conditions-differing 
I.Q.'s, unfamiliarity with phraseology, outside interferences, etc. 

The results of the Self-image test cannot be too valid as emotions are 
exceedingly hard to measure. CMldren are so susceptible to praise, criticism, 
home disturbances, a previous bad grade, disappro/ed clothing, etc. that 
accurate measurements are impossible. The Bilingual Group, however, lost none 
of its self image during any one year, although there was a perceptible drop 
from the close of one grade to the close of anothei . Each of the Control Groups 
lost during each year, increasingly so beyond the first grade. Althoug'^ this 
is a difficult area to measure it is probably the most important. factor in the 
learning rate of any child. 



STAFF DEVELOPMF>!T .^ND M/\TERIALS PRODUCTION 



In the way o£ Staff Development (Evaluation Design pp. 15, 15a, 16, 16a,) 
five workshops f^r both professional and para-professional personnel wei^e held: 



September 11, 1971 
September 14, 1971 
October 9, 1971 
December 17, 1971 
March 24, 25, 1972 



Bilingual Education - Orientation of i acuity - 57 present 

Etlinic Folklore - 58 present 

Accountability - 63 present 

Open Classroom - 77 present 

Cultural of Mexican-American Qiild - 66 present 



These served the purpose of providing opportunities for further development 
in instructional methods, evaluation strategy and curriculum development. The 
purpose was to enable teachers to diagnose areas of learning difficulties and to 
recommend correctional and instructural procedure. Tlie teachers expressed them- 
selves concerning workshops and in-service training thusly: 



11% felt them to be of average effectiveness 
34^ thought they met the needs 
39% felt they were very good. 



Furthermore in Staff Development (Design pp. 17, 17a, 18, 18a,) equipment 
was installed in classrooms feasible or left at the Project Office awaiting 
call. Training was given in use of the many available machines. Materials of 
great variety were available and supplies constantly replenished. New Materials 
were constantly being developed with five volumes of the Treasure Bool: of Stories 
being conpleted. Teachers were urged to request any materials they might desire 
and those orders were sent in* 48% of the teachers felt the materials were of 
average effectiveness, 25% thought them above average and 12% felt them to be 
very effective. In measuring the extent of usage of materials, 27% T^sed some 
materials, 30% used about half of them, 35% used more than half and 7% used all 
the materials available. 9% of teachers felt the materials lacking in Spanish, 
27% thought them average in availability, 32% thought their needs liad been met 
and 32% felt the materials very adequately available. 

Tlie School -Community Coordinator kept very detailed daily record of all 
events and visits tliat pertained to community involvement and her huge scrapbooks 
have caused much excitement and heightened interest of Bilingual activities. 
Enthusiasm hoS grown from the publicity given all the field trips, entertainments, 
parent involvement and library. The 20% increase expected has obviously been 
reached in Conmmity Involvement as noted in the Design p. 19, 20, 21. Attendance 
at school affairs rose 219%, field trip participation some 75%. Library 
popularity increased about 80% with users including teachers, high sc}iool students 
and townspeople not ordinarily too library -conscious. 

In accordance with the Design p. 22 and 23 the Project Director has ful- 
filled the extensive list of requirements. In addition he has liad to work over 
his budget countless times to satisfy requests from higher offices, entertain 
so many out of town interested persons involved in similar prcjects and listen 
to so many tales of woe that this evaluator is amazed at his ability to be so 
patient, tenacious, and efficient. 



